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Sir: 
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Real Party in Interest 



The real party in interest is TVWorks, LLC, a joint venture of Comcast Corporation 
and Cox Communications, Inc., with a place of business at Two Belvedere Place, Mill Valley, 
C A 94941. 

Related Appeals and Ini erferences 

Appellants are not aware of any related appeals or interferences. 
Status OF Claims 

Claims 1-6, 8, 10, 1 1, 13-16, 1 8, 20, and 39-42 are pending, have been finally rejected 
and are the subject of this appeal. In particular, claims 1, 2, 5, 6, 8J 1, 15 ,16, 18 and 39-42 
were rejected under 35 USC 102(e) as being anticipated by Kikinis (US Patent 5,929,849); 
claims 10 and 20 were i-ejected under 35 USC 103 in view of Kikinis and knowledge in the art 
concerning ATVEF triggers; and claims 3, 4, 13 and 14 were rejected under 35 USC 103 in 
view of Kikinis and Portuesi (US Patent 5,774,666). All of these rejections are addressed in 
this appeal. 

Claims 39 and 40 were rejected under 35 USC 101 as being directed to non-statutory 
subject matter, however, this rejection has been overcome and so is not addressed in this 
appeal. In the claims appendix, claims 39 and 40 are presented with the Rule 1 16 
amendments entered. 

Claims 7, 9, 12, 17, 19, and 2 1 -38 have been cancelled. 

Status of Amendments 

A Rule 1 16 amendment, filed 20 September 2008 has been entered. As a result, tlie 
rejection of claims 39 and 40 under 35 USC 101 has been overcome (see Advisory Action 
dated 8 October 2008). Claims 39 and 40 remain rejected under 35 USC 102(e) as discussed 
above. 
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Summary of Claimed Subject Matter 

Claims K 1 1 and 39 are independent claims in this application and read as follows:* 

1 . In an interactive television (TV) environment, a 
method comprising: 

recognizing, using a pattenn engine [305], one or more 
patterns in an unmodified broadcast data stream [702]; 

accessing a repository [304A] storing attributes [625] 
concerning interactive TV tri^ers [630] to be inserted into the 
broadcast data stream [600] and detemiining whether a pattern 
recognized by the pattern engine is to be associated with a one 
of the interactive TV triggers [704]; and, if so, then 

prior to broadcasting, automatically inserting [504] an 
interactive TV trigger determined to be associated with a 
recognized pattern into the broadcast data stream [708]. 

I I. In an interactive television (TV) system environment, 
a system comprising: 

an insertion platform [110] configured to recognize 
[702], using a pattern engine [305], one or more patterns in an 
unmodified broadcast data stream; access a repository [304A] 
storing attributes [625] concerning interactive TV triggers 
[630] to be inserted into the broadcast data stream [600]; 
cletenTiine [704] whether a pattern recognized by the pattern 
engine [305] is to be associated with a one of the interactive 
TV triggers; and, if so, then to insert automatically [504, 708], 
and prior to broadcasting the data stream, those of the 
interactive TV triggers determined to be associated with 
recognized ones of the patterns into an unmodified broadcast 
data stieam. 

39. A tangible machine-readable medium encoded with 
computer-executable instructions, which if executed by a 
computer, cause tlie computer to perform an operation 
comprising: 

recognizing [702], using a pattern engine [305], a 
media pattem [602] in an unmodified broadcast data stream 
[600], 

accessing a repository [304A] storing attributes [625] 
concerning interactive TV triggers [630] to be inserted into the 
broadcast data stream [600] and determining [704] whether the 



' RcfeneiKC numbers as used in the drawings Imve been ii^rted in ijccondance with 37 C.F.R. §4 ] .37{c)( 1 )(v). 
Tlic use of such reference nnnibci^ slx)uld in no way be read as liniiiing live claim to tiK illustrated cnibodiuKni. 
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media pattern [602] recognized by the pattern engine [305] is 
to be associated with an interactive element; and, if so, then 
prior to broadcasting, automatically inserting [504, 
708] the interactive element determined to be associated with 
the media pattern into the broadcast data stream. 

As is apparent from these independent claims, the present invention concerns methods and 
systems for use in an interactive television (iTV) environment, in particular, methods and 
system which allow for the automated insertion of iTV triggers into a broadcast data stream, 
prior to the broadcast of that data stream. 

As explained in the present application, iTV environments allow users to interact with 
a broadcast or seivice being provided. This may include enhanced, interactive content 
("interactive content") such as a Universal Resource Locator (URL) address in which a TV 
user can select to access a website on the Internet or World Wide Web at the selected URL 
address. However, conventional iTV systems require broadcasters to manually modify each 
television program to add such interactive content prior to broadcasting. As such, a great deal 
of effort is needed to bring interactive content to iTV users and so the industry has 
experienced unwanted delay in deploying interactive content with broadcast programs. 
Specification at [0003] - [0004], 

To overcome these deficiencies in the art, the present invention provides for automatic 
insertion of iTV triggers into a broadcast data stream, for example based on the recognition of 
one or more elements within the broadcast data stream. In particular, a recognized element can 
trigger the insertion of the interactive TV trigger into the broadcast data stream Specification 
at [0005]. The iTV trigger can be based aiiy of a variety of interactive content industry 
standard formats, for example those published by the Advanced Television Enhancement 
Forum (ATVEF) for Transport Type A or Transport Type B, or other fomiats. Specification 
at [0019], When a television with a set-top box is used to receive and display a broadcast with 
an iTV trigger inserted therein, the iTV trigger can be used to retrieve information from web 
server (or other resource) for display on the TV. Specification at [0020]. 

To facilitate the automated insertion of the iTV triggers into the unmodified broadcast 
data stream, the present invention provides an insertion platform architecture. This insertion 
platform architecture automatically inserts iTV triggers into a broadcast data stream based on 
elements contained within that broadcast data stream. These elements are recognized using a 



pattern engine within the insertion platform architecture and comparing same to attributes 
stored in a database accessible to the insertion platform architecture. Thus, when elements 
within the broadcast data stream are deeiTied to match one of the stored attributes, the insertion 
platform architecture automatically inserts iTV triggers into the broadcast data stream. 
Specification at [0024] - [0025], [0033], and [0039] - [0040]. 

By way of illustrative example, suppose an advertisement for a particular clothing 
store is being broadcast. Then, the insertion platform architecture may be used to 
automatically insert an iTV trigger in the form of a URL for the clothing store's web site into 
the broadcast data stream so as to be concurrently displayed on a TV wi th the ad verti sement. 
A user using a remote control may select the URL to visit the company's web site. 
Specification at [0028] - [0029]. 

Grounds of Rejection to be Reviewed on Appeal 

1 . Whether claims 1, 2, 5, 6, 8, 11,15, 16, 18 and 39-42 are patentable over Kikinis 
(US Patent 5,929,849)? 

2. Whether claims 10 and 20 are patentable in view of Kikinis when considered 
together with knowledge in the art? 

3 . Whether claims 3, 4, 13 and 14 were rejected under 35 USC 103 in view of Kikinis 
and Portuesi (US Patent 5,774,666)? 

Argument 

1. The present claims are patentable over Kikinis, because Kikinis does 
NOT describe recognizing one or more patterns in an unmodified broadcast 
data stream and, prior to broadcasting, automatically inserting 
interactive triggers based on this recognition in the manners presently 
claimed. 

Kikinis is relied upon in rejecting all of the present claims in one form or another. 
However, this reliance is misplaced because Kikinis does not teach or suggest recognizing one 
or more patterns in an unmodified broadcast data stream and, prior to broadcasting, 
automatically inserting interactive triggers based on that recognition, as presently claimed. 
Instead, Kikinis relies upon the use of outside instrumentalities (e.g., scanners) to detect 
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patterns (e.g., bar codes) applied to real worid objects and, based on these detections, to add 
triggers to a television broadcast. Hence, the claims are patentable over Kikinis, whether 
considered alone or in combination with knowledge in the art regarding ATVEF triggers. 

To better understand this proposition, consider that Kikinis describes a system in 
which TV viewers are provided with a link to supplementary information pertaining to 
displayed images received at a set-top box. This is accomplished by inserting, on a frame-by- 
tVame basis, a URL link within each frame (or in locations between frames) of a broadcast and 
associating the link with a position of an element within the subject frame. Kikinis, col. 10, 11. 
6-1 1 . Inherent in Kikinis then is the concept of modifying the broadcast stream. 

Consider, for example, the scenario of a prerecorded advert sement. In such cases, 
Kikinis states that the advert sement is edited off-line (i.e., prior to broadcast) in order to insert 
desired links, etc. Kikinis at col. 10, 11. 18-55. Thus, this form of URL insertion does not 
involve recognition of patterns in an unmodified broadcast data stream as claimed. Instead, 
objects are identified in a non-broadcast data stream. 

In the case of live broadcasts however, where only minimal delay can be tolerated, 
separate data processing equipment is needed in order to associate an object in a frame with a 
URL. Kikinis at col. 10, 11. 62-67. Kikinis indicates that this may be done in either of two 
ways: Either the person or object to be associated with the URL must be equipped with special 
devices to signal the data processing equipment (Kikinis at col. 1 U II. 2-5), or the object or 
individual must be bar coded (Kikinis at col. 1 1 , II. 23-25). 

In the former case, transmitting a signal to the data processing equipment does not 
involve recognizing patterns in an unmodified broadcast data stream. Instead, the technique 
makes use of external (from the point of view of the broadcast stream) signaling to indicate the 
need for URL insertion. Thus, the claims are patentable over such a scheme. 

In the latter case, recognizing bar coded clothing or objects, the same is true. That is, 
the bar code i-eader or scanner would be external to the broadcast system and would be used to 
read bar codes directly from the objects or individuals that are the subject of the television 
broadcast. Rather than examining the broadcast data stream itself, the bar code scanner reads 
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the bar codes from the real world objects. This is a markedly different scheme than that 
recited in the present claims, where a pattern engine is used to recognize patterns in an 
unmodified broadcast data stream. Hence, all of the presently pending claims are patentable 
over Kikinis. 

With respect to claims 10 and 20, the Office Action indicates that the use of ATVEF 
triggers is well known in the art. Whether or not this is true, even if Kikinis were concerned 
with the use of ATVEF triggers the above-described differences between the schemes 
employed by Kikinis and those presently claimed would remain. Therefore, the present 
claims would still be patentable over Kikinis in light of this knowledge in the art. 

2. The present clafms are patentable over Kikinis in view of Portuesi, 

BECAUSE neither REFERENCE DESCRIBES RECOGNIZING ONE OR MORE PATTERNS IN AN 
UNMODIFIED BROADCAST DATA STREAM AND PRIOR TO BROADCASTING, AUI OMATICALLY 
INSERTING INTERACTIVE TRIGGERS BASED ON THIS RECOGNITION, AS PRESENTLY CLAIMED, 

Portuesi (U.S. Patent 5,774,666) describes a system and method for displaying an 
active uniform network resource locator (URL) embedded in a time-based medium. Upon 
activation of this locator by a user the referenced resource is retrieved and displayed. Portuesi . 
Abstract. However, Portuesi does not teach or suggest use of a pattern engine to recognize 
patterns in an unmodified broadcast data stream, and consulting a repository storing attributes 
concerning interactive TV triggers to be inserted into the broadcast data stream is accessed to 
determine whether a pattern recognized by the pattern engine is to be associated with a one of 
the interactive TV triggers, as presently claimed. 

Instead, in the system described by Portuesi, URLs are embedded in a time-based 
medium (such as a movie) by explicitly defining in a special URL track when the URLs 
should appear and where they should be placed on display. This requires explicitly associating 
the URLs with audio, image and other elements of a time-based medium using the temporal 
relationship between the various tracks.^ Portuesi col. 4, 1. 49 - col. 5, 1. 12; and col. 5, 11. 20- 
27 and 40-45, 



^ Tiibk>^ 1-8 {cq\s, 7-8) iin Porlutsi furllnir illustrtiU? thiMJxplidt (.kifinilioii of, pliKomenl <itui ItmiiY^ of Iho URL 
apptJcJraive. For onahlinj;^;) lv>Lspol, slwf>) Ixiundaritsi {o.}».. 2Dt:tx>rtiimiUa>) will htivo U> NMrxplU:itly Jol'inixi. 
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Thus, in the system described by Portuesi, there is no recognition of patterns in an 
unmodified broadcast data stream and based on such recognition, automatic insertion of 
interactive TV triggers, as required by the present claims. Consequently, adding the teachings 
of Portuesi to those of Kikinis fails to yield the present invention. 



Conclusion 

For the foregoing reasons, reversal of the Examiner's rejections as set forth in the fmal 
Office Action with respect to claims 1 -6, 8, 10, 1 1, 13- 16, 1 8, 20, and 39-42 is respectflilly 
requested. If there are any additional fees due in connection with this communication, please 
charge Deposit Account No. 1 9-3 1 40. 

Respectfully submitted, 

SONNENSCHEIN NATH & ROSENTHAL LLP 

Dated: November 17. 2008 /Tarek N. Fahmi/ „ 

Tarek N, Fahmi 
Reg. NO.4L402 

IKOBux 061080 
Wackcr Drive Station 
Scars Tower 
Chicago. I L 60606-1080 
(650) 798-0320 



Portuesi col 8 .Tablo 5. Similarly, do rations, Iraine motion asscx:ialioa oic, alst> liiive to i!xp!it:illy tUilirxKi. 
Porlutjsi col. Table Z«. 
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ClaiiMS Appendix 



Tlie claims on appeal read as follows: 

1 . In an interactive television (TV) environment, a method comprising: 

recogiiizing, using a pattem engine, one or more patterns in an unmodified broadcast data 

streani; 

accessing a rcpositorN^ storing attributes concerning interactive TV triggers to be inserted into 
die broadcast data stream and determining whether a pattem recognized by the pattem engine is to be 
associated with a one of the interactive TV triggers; and. if so, then 

prior to broadcasting, automatically inserting an interactive T\^ trigger dctemiined to be 
associated w-itli a recognized pattem into the broadcast data stream. 

2. The mctliod of claim 1 , further comprising: 

pre-insertijig the interacti ve T\^ trigger into any stored content that will constiuitc the 
broadcast data stix;am. 

3. Tlie method of claim 2, wherein the patterns include voice patterns. 

4. Tlie method of claim 2, wliereiii the patterns include other audio patterns. 

5. Tlie method of claim 2, wherein the patterns include video patterns. 

6. Tlie method of claim 2, wherein tlie pattems include text patterns as a special degenerate case 
of video pattems- 

8, Tlie method of claim I , further comprising; 

delivering the broadcast data stream w^ith the inserted interactive TV trigger to one or more 
receivers for display. 

1 0. Tlie method of claim 1 , wiiercin the interactive TV trigger includes an Ad vajiccd Television 
Enhancement Fonmi ( ATX^EF) trigger. 

11. " in an interactive television (TV) s\^stcm envinonment, a system comprising: 

an insertion platfomi configured to recognize, using a pattem engine, one or more pattems in 
an unmodified broadcast data stream; access a repositoo' storing attributes concerning interactive TV 
triggers to be inserted into the broadcast data stream; detemiine whetlier a pattem recognized by tlic 
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pattern engine is to be assoeiated witli a one of the interactive TV triggers; and, if so, then to insert 
aiitomaticalhs and prior to broadcasting the data stream, tliose of the interactive TV triggers detemiined 
to be associated with recognized ones of the patterns into an unmodified broadcast data stream. 

1 3. The SN'Stem of claim 1 1 , wherein the patterns include voice patterns. 

14. TIk SNSteni of claim 1 1 . wherein the patterns include other audio patterns. 

15. Tlie s\' stem of claim 1 1 , wherein the patterns include video pattems. 

1 6. The s\ stem of claim 1 1 , wherein the pattems include text pattems as a special degenerate case 
of video pattems. 

1 8. The s> stem of clajm 1 1 , fiarther comprising: 

a delivering unit to deliver the broadcast data stream witli die inserted interactive TV trigger 
to one or more receivers for display. 

20. Tlie system of claim I L wherein tlie interactive TV trigger includes an Advanced Television 
Enhancement Fomm (ATVEF) trigger. 

39. A tangible machine-readable medium encoded with computer-executable instmctions, which 
if executed by a computer, cause the computer to perfbmi an operation comprising: 

recognizing, using a pattern engine, a media pattern in an unmodified broadcast data strcam; 

accessing a repositors' storing attributes concerning interactive TV tnggers to be inserted into 
the broadcast data stream ajid determining whether tlie media pattern recognized by the pattern engine 
is to be associated with an interactive element; and, if so, tlien 

prior to broadcasting, automatically inserting tfie interactive element detemiined to be 
associated witli the media panem into the broadcast data strcam. 

40. Tlie tajigiblc machine-readable medium of claim 39, ftirthcr encoded widi computer- 
executable instnictions, which if executed by the computer, cause the computer to perfomi an operation 
comprising: 

passing the broadcast data stream to one or more receivers without inserting any interactive 
elements if the media pattem recognized by tlie pattern engine is not to be associated with any 
interactive elements. 

41. Tlie method of claim 1 , wherein the patterns comprise media pattems. 
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The system of claim 1 1 , wherein tlic patterns comprise media patterns 
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Evidence Appendix 
None. 
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Related Proceediivgs Appendlx 



None. 
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